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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.1 14, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is eligible 
for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1 .17(e) has been 
timely paid, the finality of the previous Office action has been withdrawn pursuant to 37 CFR 
1.1 14. Applicant's submission filed on 12/19/2007 has been entered. 

Claims 1,8,9,12-14,17-20, and 22-27 remain pending. 

Response to Amendment/Arguments 
The Examiner has modified the previous art-based rejections to teach the amended 
claims. Specifically, Singhal teaches the loss of ownership in response to a corresponding 
address packet, which correspond to a change of ownership (e.g. the ReadToOwn transaction 
that appears on the address bus) - [21/53-56]. 

Applicant argues on page 9 of the response disagreeing with the broad interpretation 
made by the Examiner when equating the output queue 162 to be a "memory subsystem" but 
does not argue why such an interpretation is invalid. Applicant's claims do not further limit the 
term of a "memory subsystem," and therefore a broadest reasonable interpretation would be any 
memory that is part of a system. While the output queue is "nothing more than a buffer," the 
output queue, nonetheless, is a type of memory that performs the same functions of the claimed 
subject matter. 
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Applicant argues on page 9 that the prior art of record does not teach the new limitation 
of transition of an access right in response to an address packet for a processing subsystem that 
has an access right but not an ownership responsibility for the coherency unit. The Examiner 
notes that such a situation coincides when a processing subsystem that can access a coherency 
unit (e.g. contains a valid copy of the coherency unit) but is not the owner receives an indication 
that another processing subsystem wants exclusive access to write the coherency unit. Such a 
limitation is taught by Singhal. Singhal teaches where an additional processing subsystem has an 
access write to but not at ownership responsibility for (as authorship lags ownership - [28/3-4]) 
and the additional processing subsystem is configured to transition (e.g. relinquish) its access 
right to the coherency unit in response to the invaliding address packet (the ReadToOwn is an 
invalidating address packet when received by a processing system that has an access right to the 
cache line - [28/31-34]). 

Claim Rejections - 35 USC § 112 

The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

Claim 12 is rejected under 35 U.S.C. 1 12, second paragraph, as being indefinite for 
failing to particularly point out and distinctly claim the subject matter which applicant regards as 
the invention. 

The scope of claim 12 is indefinite as it claims dependency to cancelled claim 11. 
Nonetheless, for the purposes of examination, the Examiner has considered the claim to be 
dependent on claim 1 . 



Application/Control Number: 1 0/82 1 ,564 Page 4 

Art Unit: 2186 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 1,8,9,12-14,17-20, and 22-27 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Gharachorloo et al (U.S. Patent Application Publication No. 2002/0124144) in 
view of Singhal et al. (U.S. Patent No. 5,987,874) in further view of Van Doren et al. (U.S. 
Patent No. 6,209,065). 

As per claims 1 and 19, Gharachorloo teaches: 

(1) a node 102 in figure 1 which includes a processing subsystem (combination of CPU 
106 and associated caches 108 and 1 10) and an interface (combination of elements 
122,124,136,130,12, and 128) coupled by an address network and a data network (1 12 as well as 
interconnects that couple the components of the interface together), since the interface is capable 
of sending and receiving both data and address requests/responses (TJ158); 

(2) an additional node 102, 104 including an additional processing subsystem 
(106,108,1 10) and an additional interface (as define above) coupled by an additional address 
network and an additional data network (as defined above) - ]]49 teaches multiple nodes are 
components of the system of figure 1 ; 

(3) an inter-node network 134 configured to convey communications between the node 
and the additional node, wherein the interface and the additional interface are coupled to send 
and receive communications on the inter-node network - ]]50; 
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(4) Gharachorloo does not specifically teach as part of the coherency transaction 
involving a coherency unit cached by the processing subsystem, the processing subsystem being 
configured to transaction an access right to the coherency unit in response to the processing 
subsystem receiving a data packet via the data network and to transition an ownership 
responsibility for the coherency unit in response to receiving a corresponding address packet on 
the address network w herein the processing subsystem transitions the access right at a different 
time than the ownership responsibility. 

Singhal teaches such cache coherence with respect to [27/50 - 28/30]. A processing 
subsystem (e.g. board) may become the owner of the cache line as soon as it requests ownership 
using a readtoown address packet [27/64-66]. Additionally, a processing board may transition, 
or lose ownership, in response to receipt of a corresponding address packet , which corresponds 
to a change of ownership (e.g. the ReadToOwn transaction that appears on the address bus 
corresponds to a requested change of ownership) - [21/53-56]. Singhal further teaches a 
processing subsystem may be granted an access right (e.g. authorship [28/3-1 1], the ability to 
write the cache line) when the actual data is received by the processor; therefore, in response to a 
data packet on the data network , an access right transition occurs. Singhal teaches such an 
approach to disassociate ownership with the reception of the data packet, alleviates cache line 
owners of other systems from having to respond to requests for ownership within a small 
window allotted for data transfer [27/55-62]. Therefore, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to have combined the cache 
coherency system of Gharachorloo with the ownership/access right transition timing system of 
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Singhal in order to have alleviated the difficulty of transferring data ownership and access rights 
for data in the system of Gharachorloo by a single owner is such a small window of data transfer. 

Singhal further teaches that the address packet and the data packet are part of a 
ReadToOwn transaction initiated by the processing subsystem - [27/64 - 28/1 1] - (a ReadToOwn 
transaction supplies an address on the address bus for ownership and receives the data on the 
data bus when it is relinquished by the previous owner). 

Neither Gharachorloo or Singhal teach specifically teach the interface in the node is 
configured to delay providing the data packet on the data network until the interface receives an 
indication that shared copies of the coherency unit in the additional node have been invalidated. 
Gharachorloo teaches fl|181) that the cache line is forwarded immediately from the RCE 124 
(interface) to the requesting processing when it is received along with an indication that the 
transaction is not complete (as other processors need to invalidate their copy of the requested 
cache line). Once all of the acknowledgements have been received, the RCE sends an additional 
message fl|182) to the processor indicating that the transaction is complete and that the cache line 
may now be written to (e.g. access right obtained). Such a method involves an additional 
message being sent to the requesting processor and therefore and increase in the traffic of the 
data bus between the RCE interface and the processors. 

Conversely, Van Doren teaches a controller (180 figure 1, e.g. an interface ) regulates a 
request by a processor to obtain exclusive rights for a cache line [19/6-21]. Only after the 
FrdMod x probe (e.g. the data from the previous owner of the cache line) and all invalidation 
acknowledgements have been received, will the controller forward the data to the requesting 
processor. 
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Therefore, it would have been obvious to one having ordinary skill in the art at the time 
the invention was made to have combined the cache coherency system of modified Gharachorloo 
with the teaching of delaying the transfer of data to a requesting processor until all invalidation 
acknowledgements have been made by other processors in order to have (1) lowered the 
messaging traffic between the interface and the processors, thereby increasing the bandwidth of 
the bus and (2) ensured that the requesting processor would not violate cache coherency by 
writing to the cache line before other processors had invalidated their copies. 

The Examiner is considering the intra-chip switch interfaces (herein "ISI") 156 of the 
processing subsystems (refer to figure 3) to be part of the address network as the ISI is 
responsible for communication and message passing between switch 1 12 and the processor 
subsystem (106,108, and 110) - 1J61. In response to the address packet portion (e.g. the read- 
exclusive request's inherent address portion, as a receiving node must know what data is being 
requested in order to fulfill the read-exclusive request thereby making the address packet an 
inherent portion of a read-exclusive transaction) of a rcad-cxclusivc request being sent from the 
processing subsystem fl|170 and figure 12A, step 1200) and received via the output queue 162 of 
the address network (figure 3 and]f61), a memory subsystem (output queue 162) included in 
the node is configured to send a data packet (e.g. a packet encoded as a read-exclusive request 
that contains the requested memory address as well as an indication that the processor 106 
requests exclusive access as opposed to read/share access - Tfl59, as the processor 106 is 
responsible for initializing such a request - 1|170) indicating the read-to-own (read-exclusive) 
transaction to the interface (specifically, the switch 1 12 portion of the interface as defined 
supra), wherein the interface (specifically, the RPE 124) is configured to forward a read-to- 
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own message on the inter-node network 134 (i.e. to the home node for the memory line) in 
response to receiving the data packet indicating the read-to-own transaction flfl70). 

The additional interface (in this case the home node's interface) is configured to 
receive the read-exclusive message via the inter-not network 134 flfl71) and to responsively 
send an invalidating address packet on the additional address network (as defined supra) 
(1(171 - where the invalidating address packet is sent to the L2 cache to invalidate the memory 
line in the caches of the home node). 

Singhal teaches wherein in response to the additional processing subsystem having 
an access right to but not an ownership responsibility for the coherency unit (as 
authorship/write access lags ownership of the cache line - [28/3-4]), the additional processing 
subsystem is configured to transition its access right (e.g. invalidate the cache line) to the 
coherency unit in response to the invalidating address packet (the ReadToOwn is an 
invalidating address packet when received by a processing system that has an access right to the 
cache line - [28/3 1-34]). As discussed by Singhal, the system used the ReadToOwn address 
packet to invalidate the valid copies of the cache lines of processing subsystem that cache valid 
copies (e.g. the processing subsystems contain access rights to the cache line that is to be 
invalidated by the incoming ReadToOwn). 

As per claim 8, the interface (specifically the RPE 124) is configured to forward a read- 
to-own message corresponding to the address packet (i.e. the read-exclusive address request) to 
the additional interface via the inter-node network 134 in response to receiving the address 
packet - If 170. The received request is forwarded to the home node, where additional processing 
takes place as taught in If 170. 



Application/Control Number: 1 0/82 1 ,564 Page 9 

Art Unit: 2186 

As per claim 9, the coherency unit is not mapped by any memory subsystem included in 
the node and wherein the additional node is a home node for the coherency unit. This can be 
seen as the request must be forwarded to the home node for the memory line in order to obtain 
the dataHfl71-172. 

As per claim 12, wherein in response to receiving the invalidating address packet on the 
additional address network, the additional interface is configured to send via the inter-node 
network 134 a message indicating that copies of the coherency unit (memory line) in the 
additional node (i.e. the home node) have been invalidated to the interface (HI 72). The reply 
sent from the home node to the requesting node, which includes the memory line, includes the 
number of invalidation acknowledgements that arc outstanding from other nodes. This message 
thereby indicated that the copies of the data cached in the home node have been invalidated. 

As per claim 13, the additional interface is configured to send an additional address 
packet on the address network (e.g. the address packet used to invalidate the cache of the 
processor caches 108,1 10), wherein if the additional processing system has an ownership 
responsibility associated with the coherency unit, the additional processing system is configured 
to transition the ownership responsibility (e.g. invalidate its copy) upon receiving the additional 
address packet fl|171). Such a transition is reflected in the directory 180 which contains 
ownership responsibilities for all processing subsystems of a given node - see ](66 and TJ75. 

As per claim 14, wherein the additional processing system is configured to send a data 
packet corresponding to the coherency unit to the additional interface in response to receiving the 
additional address packet (e.g. the up-to-date memory line is sent from the owner node to the 
requesting node - 1(178), wherein the additional processing subsystem is configured to transition 
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an access right (i.e. invalidate its cached copy of the requested data) associated with the 
coherency unit in response to sending the data packet corresponding to the coherency unit - TJ178. 

As per claim 17, Singhal teaches the access right to the coherency unit cached by the 
processing subsystem (in this case the coherency unit is buffered in a bcopy buffer or a streaming 
I/O buffer as will be described) transitions in response to the processing subsystem receiving a 
data packet via the data network [28/10-1 1], wherein the data packet is provided to the 
processing subsystem as part of a write stream transaction [16/49 - 17/7] initiated by the 
processing subsystem. Here, the initiating processing subsystem is the "initiator" and the 
processing subsystem considered to be the "home node" of the requested data is the "responder." 

As per claim 18, the data packet is an encoded acknowledgement (data packet sent from 
the responder is encoded to only contain the DatalD when ready to accept the data - [16/66 - 
17/4]) that excludes data (only the DatalD is sent as discussed) corresponding to the coherency 
unit (e.g. cache line). 

As per claim 20, Singhal teaches the address packet and the data packet are part of a 
transaction (Read-to-Own) initiated by the processing subsystem - [14/19-67], wherein the 
transaction also includes an additional address packet (local address packet once received over 
the omnibus 30 - [14/32-34]) sent on the additional address network (the responder's (e.g. cache 
line owner) portion of its address bus (portion of line buses 40) and at least one message sent on 
the inter-node network 30 - the asserting of the Owned signal and the fulfilling of a response 
from the owner processor [14/40-42]. 

As per claim 22, Gharachorloo teaches (figure 12B, steps 1226-1230 and figure 12C, 
steps 1232-1234) that the additional interface (e.g. the home node's interface, specifically the 



Application/Control Number: 1 0/82 1 ,564 Page 1 1 

Art Unit: 2186 

HPE 122 portion of the interface) broadcasts an invalidation address packet on the additional 
address network (this can be seen since if one of its processors 106 contains the cache line, the 
address must be sent to that processor via the data bus portion of switch 122 in order to 
invalidate the cache line). Singhal also teaches broadcasting the address on the address bus in 
order to invalidate the cache line in the other sharing processors - [28/31-34]. 

As per claim 23, Gharachorloo teaches the sending back of the invalidation 
acknowledgments from the additional interface to the interface (of the requesting node), wherein 
the message indicates that the shared copies have been invalidated at the additional node flit 180- 
181). Singhal teaches that if the additional processing subsystem has an access right (e.g. is an 
author) to but not an owner of the cache line (could not be during a readtoown as ownership is 
transferred at the time of request - [27/64-66]), the additional processing subsystem is configured 
to transition the access right to the coherency unit (cache line) upon receipt of the invalidating 
address packet [28/3-1 1]. 

As per claim 24, Singhal teaches the transaction is a read-to-own transaction [14/17-67], 
wherein the processing subsystem is configured to initiate the read-to-own transaction by 
sending a read-to-own packet on the address network [12/47 - 13/5]. 

As per claim 25, Singhal teaches wherein no memory subsystem (i.e. memory 150) 
included in the node (i.e. the requesting node) maps the coherency unit (i.e. the memory line is 
mapped to another node or device 50) - [14/28-39] and [22/1-19], wherein in response to the 
read-to-own packet on the address network, the interface (elements 140 and 180) is configured to 
send a read-to-own message to the additional interface in the additional node (messages sent via 
the omnibus 30 in a broadcast method - [12/47-62]. 
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As per claim 26, Gharachorloo teaches the address network (specifically the switch 112) 
is configured to convey the address packet (e.g. the address portion of the read-exclusive request 
packet) from a directory (e.g. a Dtag array) to the processing subsystem (i.e. when the address is 
used to invalidate data cached locally that is associated with a received read-exclusive request) in 
a point-to-point mode (this can be seen since the invalidation is only sent to those processing 
subsystems (e.g. combination 106,108, and 1 10) which contain the data corresponding to the 
read-exclusive request via switch 1 12) - ^[171 . The Dtag array is used to locate which processor 
caches contain the data to be invalidated from the received address packet, and the L2 cache 
executes a point-to-point invalidation request using the address packet (i.e. the address packet 
inherently must be sent as it contains the address of the associated memory line to be invalidated) 
to only those caches 108,1 10 that contain the associated data. 

As per claim 27, Singhal teaches the address network conveys the address packet in 
broadcast mode [7/37-40]. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to SHANE M. THOMAS whose telephone number is (571) 272- 
4188. The examiner can normally be reached M-F 8:30 - 5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matt M. Kim can be reached at (571) 272-41 82. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

/Shane M Thomas/ 1 2 March 2008 

Primary Examiner, Art Unit 2186 



